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Abstract. In human societies the probability of strategy adoption from a given person may be affected by 
the personal features. Now we investigate how an artificially imposed restricted ability to reproduce, over- 
ruling ones fitness, affects an evolutionary process. For this purpose we employ the evolutionary prisoner's 
dilemma game on different complex graphs. Reproduction restrictions can have a facilitative effect on the 
evolution of cooperation that sets in irrespective of particularities of the interaction network. Indeed, an 
appropriate fraction of less fertile individuals may lead to full supremacy of cooperators where otherwise 
defection would be widespread. By studying cooperation levels within the group of individuals having 
full reproduction capabilities, we reveal that the recent mechanism for the promotion of cooperation is 
conceptually similar to the one reported previously for scale-free networks. Our results suggest that the 
diversity in the reproduction capability, related to inherently different attitudes of individuals, can enforce 
the emergence of cooperative behavior among selfish competitors. 



PACS. 02.50.Le Decision theory and game theory 
systems 

1 Introduction 

Evolutionary game theory is a successful paradigm for 
studying interactions among individuals as different as 
bacteria 1^ and humans 2 . One branch of game theory 



- 89.75.Fb Structures and organization in complex 

considers the problem of cooperation as a particular ex- 
ample of such interactions. The conflict between the in- 
dividual and common interests is frequently modeled by 
the so-called prisoner's dilemma game [3]. Originally the 
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game consists of two players who have to decide simulta- [T51ll4| . Noteworthy, the loners also promote cooperation 
neously whether they want to cooperate or defect. Mutual in the absence of spatial interactions. Moreover, the im- 
cooperation yields the highest collective benefit shared pact of variable degrees of investment in the prisoner's 
equally between the players. However, a defector can have dilemma game has also been studied, as was the suitable 
a higher individual payoff if the opponent decides to co- walk of agents on the grid [IS , as well as fine-tuning of 
operate. Therefore both players decide to defect, whereby noise and uncertainties by strategy adoptions [TB1I171IT5] . 
they end up with a lower payoff than if both would co- 

To exceed the simplest lattice graphs, more specific 

operate; hence the dilemma. This unfavorable result of 

topologies of networks defining the interactions among 

classical game theory is, however, often at odds with real- 
individuals were also studied [T9ll20j . which has received 

ity [1]. Accordingly, several mechanisms, ranging from kin- 
substantial attention (for a review see [H]). More specifi- 

selection to various forms of reciprocity 5] and other more 

cally, the celebrated scale-free graph has been recognized 

sophisticated processes ^ , have been proposed to explain 

as an extremely potent promoter of cooperative behav- 

the emergence of cooperation. Particularly inspiring in the 

ior in the prisoner's dilemma as well as in the snowdrift 

latter aspect, and still widely investigated, is also the spa- 
game [22 1 123 ] , and this promotion of cooperation has been 

tial extension of the classical prisoner's dilemma game [71 

found robust on several factors [24j . However, one may ar- 

[8l[9] as well as other games with different payoff rankings 

gue that the many links of a hub involve not just a higher 

[TO] . Although the outcome of so-called games on grids de- 
payoff but a higher cost as well. Therefore, the use of nor- 

pends somewhat on their numerical implementation [11 , 

malized payoffs may represent a more realistic approach 

the cooperation-facilitating effect in the context of the 

[25j . Indeed, the introduction of participation costs eradi- 

prisoner's dilemma game is robust. 

cates the ability of scale-free networks to promote cooper- 
The success of the spatial prisoner's dilemma game ation [25], yielding similar levels of cooperative behavior 
to sustain cooperation has made it a common starting as regular grids introduced initially by Nowak and May [7] . 
point for further explorations of mechanisms that could Very recently, Pacheco et al. have reported that a suitable 
facilitate cooperation even beyond the borders determined dynamical linking helps to maintain cooperative behavior 
solely by the spatial extension. For example, it proved very [?f[|28j . whereas on the other hand, Ohtsuki et al. have 
successful to introduce a third strategy into the game, shown that the separation of the interaction and strat- 
The so-called loners, or volunteers, induce a rock-scissors- egy adoption graphs completely disables the survival of 
paper-type cyclic dominance of the three strategies [H] cooperators if the overlap between the two graph is zero 
and are able to prevent, via oscillatory changes, the ex- [291l30j . Inhomogeneities in the strategy adoption proba- 
tinction of cooperators even by high temptations to defect bilities can also enhance the frequency of cooperators [3TJ 
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[32] . particularly if the strategy adoption is favored from scale- free networks. Indeed, our results imply that several 
some distinguished players [33| . It is worth mentioning recently introduced mechanisms for the promotion of co- 
that the introduction of other inhomogeneities in the per- operation within the prisoner's dilemma game are routed 
sonality (e.g., stochastic payoffs [34], different aspiration in diversities of participating players, which may emerge 
levels for the win-stay-lose-sift strategies |35| , or even in- intrinsically due to an inhomogcneous interaction network 
dividual acceptance levels for the evolutionary Ultimatum |23j , or can be introduced extrinsically via social diversity 
games |36| ) can also support the altruistic behavior under [37j or reproduction restrictions. 

certain conditions. The remainder of this paper is structured as follows. 

Section [2] is devoted to the description of particularities of 

In this paper, we extend the above investigations by 

the evolutionary prisoner's dilemma game and reproduc- 

introducing the diversity of reproduction of individuals on 

tion restrictions on small- world and scale- free networks, 

two types of complex networks; namely on regular small- 
while Section [3] features the results. In the last Section we 

world graphs and on highly irregular scale- free networks. 

outline potential implications of our findings. 

To study the impact of the diversity of reproduction on the 
stationary level of cooperation explicitly, we focus on nor- 

2 Evolutionary prisoner's dilemma game 

malized payoffs by the prisoner's dilemma game. We find 

that the differences of reproduction facilitate cooperative We consider an evolutionary two-strategy prisoner's dilemma 
behavior irrespective of the interaction network and par- game with players located on vertices of either regular 
ticularities concerning payoff accumulation, and moreover, small-world graphs or irregular scale-free networks. Via 
may lead to domination of cooperation where otherwise the analogy with the creation of the Watts-Strogatz struc- 
defection would reign. Remarkably, although normalized ture, the former graph is generated from a regular two- 
payoffs can eliminate the advantage of scale-free topol- dimensional grid by randomly rewiring a certain fraction 
ogy, we observe that reproduction restrictions of players Q of nearest-neighbor links whereby preserving the initial 
that are inversely proportional to their connectivity re- connectivity Zj, = 4 of each player x [38j . Evidently, for 
store the cooperative trait across the whole parameter Q — this structure is a square lattice, whereas the limit 
range of the temptation to defect. By studying cooper- Q — > 1 yields a regular random graph. The scale-free net- 
ation levels within the group of individuals having full re- work is generated via the celebrated mechanism of prefer- 
production capabilities, and comparing those to the over- ential attachment growth [39] yielding a power-law distri- 
all fraction of cooperators, we are able to draw strong bution of but still having average connectivity z — A. 
parallels between the presented mechanism for the pro- Initially, each player x is designated as a cooperator (C) 
motion of cooperation and the one reported previously for or defector (D) with equal probability. Moreover, amongst 
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all N players, and irrespective of their initial strategies, a off 0, where 1 < 6 < 2 to ensure a proper payoff ranking, 

fraction v of players is chosen randomly and designated as More precisely, both players x and y play one round of 

having a restricted ability to transfer their strategy [S3j. the prisoner's dilemma game with all their neighbors, re- 

The parameter is crucial in the present work since it spectively. Their accumulated payoffs resulting from Zx 

determines the fraction of players having restricted repro- and Zy interactions are stored in and py . As mentioned 

duction capabilities, and accordingly, will be in the focus above, these payoffs are normalized with the number of in- 

of simulation results presented in the following Section, teractions from which they were obtained, hence yielding 

Importantly, the reproduction ability of each player is set Px — Px/zx and Py — Py/zy. Using normalized payoffs we 

only once at the beginning of each simulation and remains can separate effects described earlier by Santos et al. |22[ 

unchanged during the evolutionary process. Next, a player [53] from those appearing due to the presently introduced 

y can reproduce its strategy Sy on one of its randomly reproduction restrictions, 
chosen neighbors x (throughout this work "neighbors of 
J/" refers to those which are directly connected with y) in 
accordance with the probability 

W{sx ^ Sy) — Wy ^ ^ exp[(Pa; — Py) / K] ' ^^'^ The elementary steps of the game on the two consid- 

where Wy = w < I if player y has a restricted ability ered types of complex networks are as follows. An arbitrar- 

to transfer its strategy, and Wy = 1 otherwise. Note that ily chosen player x acquires its payoff Px by playing the 

the choice of w = in the former case would mean that game with all its neighbors. One randomly chosen neigh- 

vN players amongst all N are completely unable to re- bor of player x; we denote it by y, also acquires its payoff 

produce their own strategy, which would lead to frozen Py by playing the game with all its neighbors. Finally, 

states and stop the evolutionary process for large enough the reproduction of player y to the site of player x is at- 

i'. It is also easy to see that the stationary state at ly — tempted according to Eq. ([T]). A full Monte Carlo step 

agrees with the state at = 1 but the relaxation is slower (MCS) consists of executing the above-described elemen- 

in the latter case. Moreover, K characterizes the uncer- tary steps N times. Simulations of the evolutionary pro- 

tainty related to the reproduction process, also serving cess via the Monte Carlo algorithm were performed for 

to avoid trapped conditions and warranting smooth tran- populations comprising N = 10^ — 10^ players, and char- 

sitions towards stationary states. Payoffs Px and Py of acteristic quantities, such as the stationary frequencies of 

both players are calculated in accordance with the stan- cooperators pc and defectors pd, were averaged over a sam- 

dard prisoner's dilemma scheme [7] having temptation b, pling period {tg = 10"* — 10^ MCS) after a sufhciently long 

reward 1 , and both punishment as well as the suckers pay- transient time tr ~ tg. 
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3 Results 

The above described mechanism as a type of inhomogc- 
neous teaching activity in a social context has proved to 
promote cooperation on lattices [33j. Here we extend this 
study to explore the possible role of the topological fea- 
tures of complex graphs. To have an overview of the im- 
pact of restricted reproducibility on a regular small-world 
graph we calculated pc systematically for different values 
of Q and v while the values of K and h were held fixed. 
A typical contour plot of cooperation is plotted in Fig. [H 
where K = 0.08 and b — 1.14 were used. Within a wide 
region of v the level of cooperation [pc) is enhanced sig- 




Fig. 1. Gray scale coded fraction of cooperators pc in depen- 
dence on Q and u, obtained for K — 0.08 and b — 1.14. The 
gray scale is linear, white depicting 0.0 and black 0.45 values 
of Pc. 



nificantly and this improvement increases monotonously For larger values of w this region disappears and one can 
with the randomness of the interaction topology via Q. only observe a peak in the contour of Pc{v)- 



In particular, the fraction of cooperation can be enhanced 



To extend the studied class of connection topologies 



from = (for = and Q = 0) to pc « 0.45 if ^i^^^ ^^^^ analyzed the effect of reproduction restric- 

V = 0.6 and Q > 0.5. The cooperation level saturates if ^-^^^^ ^hc maintenance of cooperation for the strongly 

the rewiring probability exceeds the value Q « 0.5. Notice degree-inhomogeneous Barabasi-Albert scale-free network 

that the optimal value of ,^ is practically independent of ^ pjg^^g [jjb) shows that the fraction of cooperators 



{i^opt ~ 0.6). 



remains fairly low for b — 1.04 if = 0. However, as soon 



The Monte Carlo simulations show that reproduction as ly is increased the fraction of cooperators rises quickly, 

restrictions expand and shift the region of parameters for eventually reaching pc — 1 aA, 0.5. Noteworthy, the 

which the cooperator and defector strategies coexist. We optimal fraction of players suffering under reproduction 

emphasize that defectors can die out completely (pc = 1) restrictions on the scale- free network is comparable to the 

below a threshold value of fo, whereby the latter depends one identified for regular small-world networks. The simi- 

on Q, K, V and w. Figure [2ja) demonstrates the effect of larity of behavior on these networks is related to the usage 

V on the fraction of cooperators on a regular small-world of normalized payoffs that suppress the otherwise impor- 

structure for Q — 0.1. Notably, for sufficiently low values tant role of hubs by the scale-free connectivity structure 



of w there exists a central region of v for which pc ~ \. P51l40j . 
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Fig. 2. Fraction pc of cooperators when varying v. (left) on the 
regular small- world graph generated with Q = 0.1 for K = QA 
and h = 1.02; (right) on the scale-free network for K = 0.1 and 
h= 1.04. 

Since an appropriately pronounced limitation of repro- 
duction capabilities recovers the ability of scale-free net- 
works to boost cooperation to dominance even if normal- 
ized payoffs are used in Eq. ([T|) , it seems reasonable to in- 
vestigate this phenomenon more precisely in dependence 
on 6, and moreover, to test if there exist optimal ways 
of how reproduction restrictions can be introduced. Ac- 
cordingly, the results presented in Fig. [3] compare pc as a 
function of h for four different cases of reproduction restric- 
tions. In the absence of reproduction restrictions [v = 0) 
the scale-free network alone is unable to sustain cooper- 
ative behavior past b — 1.09 since normalized payoffs are 
used for the evaluation of fitness. On the other hand, the 
region of coexisting D and C strategies is shifted towards 
significantly higher values of fo; in particular, cooperators 
can survive up to 6 = 1.26 if z/ w 0.5. 

Utilizing that scale-free networks have a power-law 
connectivity distribution, it is reasonable to investigate 
what happens if the reproduction capability of players is 
proportional to their degree Zy. For this purpose we have 



studied a system with site-dependent w, i.e. Wy = Zy/zmax 
where z,-aax is the maximal number of neighbors within 
the employed scale- free network for v — 1. These types 
of dynamical rules describe the situation when strategy 
adoption along each connection (in both direction) is al- 
lowed with the same probability. The dashed-dotted line 
in Fig. [3] illustrates that in this case cooperators survive 
throughout the whole range of b. The advance of players 
with large neighborhoods can be enhanced further either 
by comparing total payoffs 22J or by artificial preferences 
as suggested previously by Ren et al. 41j. To demonstrate 
the additional enhancement the dotted line in Fig.[3]shows 
the values of pc on scale-free networks when the players 
compare their absolute payoffs, as implemented in |22j . 
From the qualitative similarity between the last two cases 
one can suspect that similar mechanisms may underlie the 
enhancement of cooperative behavior for these systems. In 
order to clarify this assumption, we have studied the level 
of cooperation within the group of individuals having high 
reproduction capabilities, denoting this as pr, that can be 
compared to the overall fraction of cooperators pc- Evi- 
dently, the players with w — \ belong to the mentioned 
group in the case of randomly distributed players with 
two possible values of reproduction capabilities. However, 
when the reproduction capability is inversely proportional 
to the degree of a node several different values of w are 
possible. Here we divide the nodes into three categories 
in such a way that each interval of the degree becomes 
equally large on the logarithmic scale. We consider play- 
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Fig. 3. Fraction of cooperators pc as a function of b when v — 
(solid line), v — 0.5 (dashed line), and when the reproduction 
restriction is proportional to the connectivity of each player 
(dashed-dotted line) if K = 0.1 The highest pc is achieved for 
the model suggested by [22] (dotted line). 

ers belonging to the "high reproduction capability class" 
if they are members of the highest connectivity group. 

Results in Fig. [4] illustrate the difference Ap = pr — pc 
as a function of pc for the small-world graph and scale- 
free network at v = 0.5, as well as for the case when 
reproduction restrictions are proportional to the connec- 
tivity of each individual (for comparative purposes results 
obtained with absolute payoffs and in the absence of re- 
production restrictions on the scale-free network are also 
shown). In the latter case, and similarly to the inversely 
proportional restriction situation, players of the studied 
group have a connectivity belonging to the top third of 
the whole interval on a logarithmic scale. 

The most important message of Fig. |4]is that Ap > 
in the whole region of parameters. In other words, the 
cooperation is preferred on the sites from where the ac- 
tual strategy can spread away faster independently of the 




Fig. 4. Excess fraction of cooperators Ap within the group 
of individuals having high reproduction capability (or connec- 
tivity) versus the overall fraction pc- The four curves (from 
bottom to top) illustrate the results obtained on the scale-free 
network with randomly distributed two- value reproduction ca- 
pability (solid line), small- world network {Q = 0.9) with ran- 
domly distributed two-value reproduction capability (dashed 
line) , scale-free network with reproduction rate proportional to 
the connectivity of each player (dashed-dotted line), and scale- 
free network with absolute payoffs as in ^2T (dotted line) . The 
simulation were performed for v = 0.5 and K = 0.1. 

mechanism yielding this process. Evidently, for pure co- 
operation {pc = 1) or defection {pc — 0) Ap = 0. In the 
close vicinity of the boundaries the enhancement vanishes 
linearly, i.e., Ap ~ if Pc << 1 and Ap 2± (1 — p^) if 
1 — Pc << 1- Between these two limits, however, values of 
Ap indicate the enhancement of cooperation level within 
the group of individuals having high reproduction capa- 
bilities. 

The above results indicate that defection cannot sur- 
vive long on network sites having high strategy reproduc- 
tion capability. This phenomenon is analogous to the one 
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reported by Santos et al. on the scale-free graph [23] . In each other with an adequate probability only if their den- 

the latter case the total payoff difference determines the sity is appropriately adjusted, i.e. neither too large nor too 

probability of strategy adoption that favors the sites with small. Despite this necessary condition, however, the sim- 

a high degree. Consequently, within the large neighbor- ulations have indicated some increase in pc even if their 

hood of a defector the fraction of defectors increases with density was very low or high, respectively. 

time, and this process yields a monotonously decreasing 

total income for the focal defector. Sooner or later this 

focal defector will adopt the strategy from another focal 4 Suminary 

cooperator whose imitation is beneficial for it, thereby, the 

focal cooperators become the players to be followed by 

We have studied the effect of inhomogeneous reproduc- 

others. In the present models a similar process takes place 

tion capabilities on the evolution of cooperation for the 

due to the introduction of inhomogeneous reproduction 

multi-agent evolutionary prisoner's dilemma game if the 

capabilities as an additional feature of players. Finally, we 

connectivity structure is described by different complex 

mention that the recently introduced promotion of coop- 
graphs, such as regular small- world graphs and strongly 

eration via social diversity in the prisoner's dilemma game 

irregular scale-free networks. Our results suggest that the 

[37] also relies on a mechanism with the same properties 

introduction of inhomogeneous reproduction capabilities, 

as described above, hence implying it is widely applicable 

representing many realistic situations in human societies 

and may serve to identify new ways of avoiding widespread 

and animal communities, is a powerful and robust pro- 
defection. 

motor of cooperative behavior that works irrespective of 
The above-described mechanism for the promotion of the complexity of the interaction network and other de- 
cooperation assumes that links between players having a tails concerning payoff accumulation and determination of 
large probability to affect their neighbor's strategy are fitness. Diversity in reproduction capabihty is a particu- 
rare [23ll42]. Most notable enhancements of pc are war- larly potent promoter of cooperation if the connectivity 
ranted by the scale-free topology, which first, provides structure ensures that many co-players follow the strat- 
extremely high inhomogeneities in the strategy adoption egy of rarely linked but potent players as it happens on 
probabihties, and second, yields practically unidirectional the scale-free graphs studied by Santos et al. 
strategy adoptions between players having large and small 

connectivity. We have to emphasize, however, that on reg- This work was supported by the Hungarian National Research 
ular graphs the randomly distributed influential players Fund (T-47003) and the Slovenian Research Agency (grant Zl- 
(players with fuU reproduction ability) are connected to 9629). A. S. thanks Zsuzsa Danku for useful discussions. 
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